Solving Continuous Action/State Problem in Q-Learning Using Extended Rule Based Fuzzy Inference Systems

نویسندگان

  • Min-Soeng Kim
  • Ju-Jang Lee
چکیده

Q-learning is a kind of reinforcement learning where the agent solves the given task based on rewards received from the environment. Most research done in the field of Q-learning has focused on discrete domains, although the environment with which the agent must interact is generally continuous. Thus we need to devise some methods that enable Q-learning to be applicable to the continuous problem domain. In this paper, an extended fuzzy rule is proposed so that it can incorporate Q-learning. The interpolation technique, which is widely used in memory -based learning, is adopted to represent the appropriate Q value fo r current state and action pair in each extended fuzzy rule. The resulting structure based on the fuzzy inference system has the capability of solving the continuous state and action problem in Q-learning. Also it can generate fuzzy rules via interacting with the environment without a priori knowledge about the environment. The effectiveness of the proposed structure is shown through simulation on the cart -pole system.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Q-learning Based Continuous Tuning of Fuzzy Wall Tracking

A simple easy to implement algorithm is proposed to address wall tracking task of an autonomous robot. The robot should navigate in unknown environments, find the nearest wall, and track it solely based on locally sensed data. The proposed method benefits from coupling fuzzy logic and Q-learning to meet requirements of autonomous navigations. Fuzzy if-then rules provide a reliable decision maki...

متن کامل

Building A Fuzzy Inference System By An Extended Rule Based Q-Learning

Building a Fuzzy Inference System (FIS) generally requires experts’ knowledge. However, experts’ knowledge is not always available. When there is few experts’ knowledge, it becomes hard to build a FIS using one of supervised learning methods. Meanwhile, Q-learning is a kind of reinforcement learning where an agent can acquire knowledge from its experiences even without the model of the environm...

متن کامل

Reinforcement distribution in fuzzy Q-learning

Q-learning is one of the most popular reinforcement learning methods that allows an agent to learn the relationship between interval-valued state and action spaces, through a direct interaction with the environment. Fuzzy Q-learning is an extension to this algorithm to enable it to evolve Fuzzy Inference Systems (FIS) which range on continuous state and action spaces. In a FIS, the interaction ...

متن کامل

Reinforcement learning based feedback control of tumor growth by limiting maximum chemo-drug dose using fuzzy logic

In this paper, a model-free reinforcement learning-based controller is designed to extract a treatment protocol because the design of a model-based controller is complex due to the highly nonlinear dynamics of cancer. The Q-learning algorithm is used to develop an optimal controller for cancer chemotherapy drug dosing. In the Q-learning algorithm, each entry of the Q-table is updated using data...

متن کامل

Self-learning fuzzy logic controllers for pursuit-evasion differential games

This paper addresses the problem of tuning the input and the output parameters of a fuzzy logic controller. The system learns autonomously without supervision or a priori training data. Two novel techniques are proposed. The first technique combines Q(λ)-learning with function approximation (fuzzy inference system) to tune the parameters of a fuzzy logic controller operating in continuous state...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002